Virtual input devices for pressure sensitive surfaces

ABSTRACT

In some examples, a processor of a system is to cause display of a virtual input device on a display device, the virtual input device corresponding to a pressure sensitive surface, and perform different tasks responsive to different touch pressures applied on a first location of the pressure sensitive surface.

BACKGROUND

A simulated reality system can be used to present simulated realitycontent on a display device. In some examples, simulated reality contentincludes virtual reality content that includes virtual objects that auser can interact with using an input device. In further examples,simulated reality content includes augmented reality content, whichincludes images of real objects (as captured by an image capture devicesuch as a camera) and supplemental content that is associated with theimages of the real objects. In additional examples, simulated realitycontent includes mixed reality content (also referred to as hybridreality content), which includes images that merge real objects andvirtual objects that can interact.

BRIEF DESCRIPTION OF THE DRAWINGS

Some implementations of the present disclosure are described withrespect to the following figures.

FIG. 1 illustrates an arrangement that includes a simulated realitysystem and a pressure sensitive surface, according to some examples.

FIG. 2 illustrates a display device display an image including asimulated reality content and a virtual input device, according to someexamples.

FIG. 3 illustrates correspondence between a touch input on a pressuresensitive surface and a control element of a virtual input device,according to some examples.

FIGS. 4-7 illustrate different examples of virtual input devices thatare displayable according to some examples.

FIGS. 8-10 are block diagrams of a simulated reality input device,according to various examples.

FIG. 11 is a block diagram of a system according to some examples.

FIG. 12 is a block diagram of a storage medium storing machine-readableinstructions according to some examples.

Throughout the drawings, identical reference numbers designate similar,but not necessarily identical, elements. The figures are not necessarilyto scale, and the size of some parts may be exaggerated to more clearlyillustrate the example shown. Moreover, the drawings provide examplesand/or implementations consistent with the description; however, thedescription is not limited to the examples and/or implementationsprovided in the drawings.

DETAILED DESCRIPTION

In the present disclosure, use of the term “a,” “an”, or “the” isintended to include the plural forms as well, unless the context clearlyindicates otherwise. Also, the term “includes,” “including,”“comprises,” “comprising,” “have,” or “having” when used in thisdisclosure specifies the presence of the stated elements, but do notpreclude the presence or addition of other elements.

Simulated reality content can be displayed on display devices of any ofmultiple different types of electronic devices. In some examples,simulated reality content can be displayed on a display device of ahead-mounted device. A head-mounted device refers to any electronicdevice (that includes a display device) that can be worn on a head of auser, and which covers an eye or the eyes of the user. In some examples,a head-mounted device can include a strap that goes around the user'shead so that the display device can be provided in front of the user'seye. In further examples, a head-mounted device can be in the form ofelectronic eyeglasses that can be worn in the similar fashion as normaleyeglasses, except that the electronic eyeglasses include a displayscreen (or multiple display screens) in front of the user's eye(s).

When viewing simulated reality content displayed by a head-mounteddevice or another type of electronic device, a user may not be able tosee a real physical input device, which may be held in the users hand(s)or may be laying on a surface (e.g., desk surface, tabletop, or anyother surface). For example, the head-mounted device may obstruct theuser's view of the real world. As another example, when looking at thedisplay device of an electronic device, the user's head may be turnedaway from the physical input device.

As a result, the user may not be able to determine where the user'sfingers are relative to control elements of the physical input device.For example, if the physical input device is a keyboard, the user wouldnot be able to determine which keys the user's fingers are over when theuser is viewing simulated reality content on the head-mounted device. Asanother example, if the physical input device is a trackpad that has atrackpad surface and control buttons, the user would not be able todetermine where the user's fingers are relative to the trackpad surfaceand the control buttons. As a further example, if the physical inputdevice is a touch sensitive display screen, the user looking atsimulated reality content while wearing a head-mounted device or lookingat the display device of another type of electronic device may not beable to see control icons or other control elements displayed by thetouch sensitive display screen.

In accordance with some implementations of the present disclosure, avirtual input device corresponding to a real input device can bedisplayed along with simulated reality content presented by a simulatedreality system. The virtual input device can be part of the simulatedreality content, or the virtual input device can be separately generatedbut can be overlaid over the simulated reality content.

As used here, a “real input device” refers to a physical input devicethat exists in the real world and that is actually used by a user toenter inputs to the simulated reality system. Inputs can be entered byuser touch of a portion of the physical input device with the user'sfinger (or fingers), or using a different input object, such as astylus, a digital pen, and so forth.

FIG. 1 shows an example arrangement that includes a real input device102. The real input device 102 includes a pressure sensitive surface104. In some examples, the real input device 102 can include a handheldcomputer (e.g., a tablet computer, a smartphone, etc.) that has a touchsensitive (and pressure sensitive) display surface, which is responsiveto different pressures applied on the touch sensitive display surface.In other examples, the real input device 102 can include a touchpad onwhich is provided the pressure sensitive surface 104; this touchpad doesnot include a display surface, but rather includes sensing circuitry todetect touch input at different locations of the touchpad, where thesensing circuitry can additionally detect different pressures applied onthe pressure sensitive surface 104.

The pressure sensitive surface 104 is responsive to touch input on thepressure sensitive surface 104 using an input object (such as a user'sfinger, a stylus, a digital pen, etc.). In addition, the pressuresensitive surface 104 is responsive to different touch pressures appliedon a particular location of the pressure sensitive surface. Thedifferent touch pressures are caused by different forces applied on thepressure sensitive surface at the particular location by the inputobject. As explained further below, different touch pressures applied onthe particular location of the pressure sensitive surface 104 can causedifferent actions to be performed.

FIG. 1 also depicts a simulated reality system 106, which includes avirtual input device management engine 108. As used here, an “engine”can refer to a hardware processing circuit, or a combination of ahardware processing circuit and machine-readable instructions (softwareand/or firmware) executable on the hardware processing circuit. Examplesof a hardware processing circuit include any or some combination of amicroprocessor, a core of a multi-core microprocessor, amicrocontroller, a programmable gate array, a programmable integratedcircuit device, and so forth.

FIG. 1 further depicts a head-mounted device 110, which can be worn on ahead of a user 112. The head-mounted device 110 includes a displaydevice, such as a display device 202 shown in FIG. 2.

Although reference is made to use of a head-mounted device in someexamples, it is noted that solutions according to some implementationsof the present disclosure can be applied to other types of electronicdevices, such as a handheld electronic device, a notebook computer, adesktop computer, and so forth.

The simulated reality system 106 can be implemented using a computer,such as a smartphone, a tablet computer, a desktop computer, a notebookcomputer, and so forth. In examples where the simulated reality system106 is sufficiently small, such as a smartphone or a game appliance, thesimulated reality system 106 can be part of or can be mounted to thehead-mounted device 110.

In further examples, the simulated reality system 106 is separate fromthe head-mounted device 110, but is able to communicate with thehead-mounted device 110 over a communication link 114, where thecommunication link 114 can include a wired link (in the form of a cable,for example) or a wireless link. A wireless link can include a Bluetoothlink, a Wi-Fi network connection, a cellular network connection, and soforth.

Although the simulated reality system 106 and the real input device 102are shown as separate components, it is noted that in other examples,the pressure sensitive surface 104 can be part of the simulated realitysystem 106.

The virtual input device management engine 108 can cause display of avirtual input device 204 on the display device 202 of FIG. 2 (which canbe part of the head-mounted device 110). The virtual input device 204corresponds to the pressure sensitive surface 104. A “virtual inputdevice” refers to a simulated input device that can be displayed to auser, but the virtual input device is not a real input device. Rather,the virtual input device is a representation of a real input device,which in the example of FIG. 1 is the real input device 102. In theexample of FIG. 2, the virtual input device 204 includes an arrangementof keys 206 (including alphanumeric keys) that are part of a keyboard.

Note that although an arrangement of keys 206 of a keyboard is depictedas part of the virtual input device 204 of FIG. 2, it is noted that thepressure sensitive surface 104 may not actually present a keyboard. Infact, the pressure sensitive surface 104 may be a blank surface that isable to receive touch inputs at different locations corresponding tokeys of a keyboard, when in fact a keyboard is actually not presented bythe pressure sensitive surface 104.

As discussed further below, in other examples, a keyboard overlay can beprovided over the pressure sensitive surface 104, where the keyboardoverlay can include structures that correspond to keys of a keyboard togive the user 112 tactile feedback regarding where the user's fingersare on the real input device 102.

In other examples, the virtual input device 204 can be a different typeof input device, such as a trackpad with control buttons, a touchsensitive display surface, and so forth. In each case, the real inputdevice 102 may not actually depict such other types of inputdevices—rather, the pressure sensitive surface 104 of the real inputdevice 102 may be a blank surface that is capable of detecting touchinput at different locations.

The simulated reality system 106 further includes a simulated realitycontent generation engine 109 to generate simulated reality content 208for display on the display device 202. As used here, “simulated realitycontent” can refer to any of the following: virtual reality content,augmented reality content, or mixed reality content. Virtual realitycontent refers to content that is completely simulated, with nodepiction of any real object. Augmented reality content refers to adepiction of a real object (such as captured by a camera) along withsupplemental content, which can include text, graphical images, or otherinformation. Mixed reality content refers to content that mergescaptured images of real objects and virtual objects that can interact.

The simulated reality system 106 can cause the simulated reality content208 to be displayed in conjunction with the virtual input device 204.The displayed virtual input device 204 can be part of the simulatedreality content 208, or the displayed virtual input device 204 can beseparately generated but can be overlaid over the simulated realitycontent 208.

In further examples, the simulated reality system 106 is able to track aposition of the pressure sensitive surface 104. In some examples, thereal input device 102 includes markings 120 that can be detected by thesimulated reality system 106, such as by a camera or other sensor of thesimulated reality system 106. As the real input device 102 is movedaround, the camera or other sensor of the simulated reality system 106is able to detect this movement based on tracking the markings 120. Themarkings 120 can include visible elements, invisible elements (e.g.,infrared elements), optical sources, and so forth, that are detectableby a camera or another sensor.

In response to the tracking of the pressure sensitive surface 104 (andmore specifically tracking the markings 120 provided on the real inputdevice 102), the simulated reality system 106 is able to adjust aposition of the virtual input device 204 as displayed by the displaydevice 202.

FIG. 3 shows an example of a user's finger 300 touching a location 302on the pressure sensitive surface 104 of the real input device 102. Thelocation 302 touched by the user's finger 300 can correspond to the “S”key on the virtual input device (referred to as a “virtual keyboard 204”in the ensuing discussion) displayed by the display device 202.

The real input device 102 is able to detect a location of a touch inputon the pressure sensitive surface 104, and an amount of pressure appliedon the pressure sensitive surface 104 at the location. The real inputdevice 102 is able to transmit over a communication link 111 informationto the simulated reality system 106, where the transmitted informationcan indicate the location of a touch input and an amount of pressureapplied at the location.

The virtual input device management engine 108 can receive indicationsof different touch pressures from the real input device 102 thatincludes the pressure sensitive surface 104.

In response to the user's finger 300 applying a first touch pressure onthe location 302 on the pressure sensitive surface 104, the virtualinput device management engine 108 causes the “S” key of the virtualkeyboard 204 to be highlighted, such as by changing a color of the “S”key relative to the color of the other keys, or by darkening orlightening the “S” key relative to the other keys. Alternatively,touching the location 302 on the pressure sensitive surface 104 with thefirst touch pressure causes the “S” key to be enlarged from a normalsize to an enlarged size, while the remaining keys of the virtualkeyboard 204 remain at the normal size. The normal size of a key refersto a size of a key that is displayed when no touch input is made on thepressure sensitive surface 104.

As used here, a “first touch pressure” can refer to a pressure that iswithin a first predefined pressure range. Any touch pressure that iswithin the first predefined pressure range is considered to be a “firsttouch pressure.” A touch pressure refers to an amount of force impartedon a surface by an input object. Similarly, a “second touch pressure”can refer to a pressure that is within a second predefined pressurerange. Any touch pressure that is within the second predefined pressurerange is considered to be a “second touch pressure.”

The touching of the location 302 with the first touch pressure does notcause the virtual input device management engine 108 to activate the “S”key of the virtual keyboard 204. Rather, the highlighting of the “S” keyof the virtual keyboard 204 provides feedback (in the form of thehighlighting of the “S” key of the virtual keyboard 204 displayed on thedisplay device 202 of FIG. 2) to the user that the user's finger hastouched a location on the pressure sensitive surface 104 thatcorresponds to the “S” key. If both of the user's hands are touching thepressure sensitive surface 104, with the different fingers of the user'shands touching different locations on the pressure sensitive surface 104(both at the first touch pressure), then multiple keys of the virtualkeyboard 204 corresponding to the touched locations can be highlightedto indicate to the user which keys are being touched by the user.

In other examples, instead of highlighting the “S” key in response tothe first touch pressure applied by the user's finger 300 on thelocation 302 of the pressure sensitive surface 104, the first touchpressure applied on the location 302 can cause the virtual input devicemanagement engine 108 to display an input object over the “S” key in theimage displayed by the display device 202. The input object can be arepresentation of the user's finger or some other input object, such asa stylus or digital pen.

More generally, in response to the first touch pressure applied on agiven location of the pressure sensitive surface 104, a feedbackindication relative to a control element of the virtual input device isprovided to the user on the display device 202, where the feedbackindication can include highlighting a control element of the virtualinput device 204, or the feedback indication can include arepresentation of an input object provided over the control element.

If the user desires to activate a specific key, such as the “S” key,then the user can apply a greater second touch pressure (greater thanthe first touch pressure) onto a corresponding location of the pressuresensitive surface 104. For example, the user's finger 300 can apply thesecond touch pressure on the location 302 on the pressure sensitivesurface 104, to cause the “S” key to be activated. The applied secondtouch pressure on the location 302 of the pressure sensitive surface 104can be communicated to the virtual input device management engine 108,which interprets the detected second touch pressure as an indicationthat the “S” key is to be activated. This can cause a respective task tobe performed. For example, if the user is entering text, then the letter“S” would be entered into a respective region displayed on the displaydevice 202. In other examples, the “S” key can correspond to a differentaction, such as an action of an electronic game that is being played bythe user.

With respect to the location 302 of the pressure sensitive surface 104,different tasks are performed by the simulated reality system 106 inresponse to different touch pressures applied on the location 302 of thepressure sensitive surface 104. A first task of the different tasksincludes highlighting the “S” key of the virtual keyboard 204, while asecond task of the different tasks corresponding to a second touchpressure causes activation of the “S” key.

More generally, a first touch pressure on a given location of thepressure sensitive surface 104 causes feedback to be provided to theuser regarding the touching of a control element of a virtual inputdevice displayed by the display device 202, while a second touchpressure applied on the given location of the pressure sensitive surface104 causes activation of the control element of the virtual input device204.

In further examples, the user 112 is able to toggle between differenttypes of input devices for use with the simulated reality system 106.The toggling to different modes can be performed in response toactivation of a physical control element 121 on the real input device102, where the control element 121 can include a control button, acontrol switch, or any other type of control element. In other examples,the mode toggling control element can be a virtual mode toggling controlelement 220 displayed on the display device 202. The user can activatethe virtual mode toggling control element 220, such as by touching arespective location on the pressure sensitive surface 104, or touchingsome other input control element.

When the user activates the mode toggling control element (121 or 220),the virtual input device management engine 108 receives an indication ofactuation of a mode toggle control element. In response to the actuationof the mode toggle control element, the virtual input device managementengine 108 causes a switch from the display of a first virtual inputdevice (e.g., a virtual keyboard) to a display of a different secondvirtual input device (e.g., a trackpad, a touchscreen, an arrangement offunction buttons, etc.). Once the switch has occurred and the secondvirtual input device is displayed, the virtual input device managementengine 108 can receive an indication of touch input (at respective touchpressures) related to the second virtual input device on the pressuresensitive surface 104.

FIG. 4 shows an example of a virtual trackpad 402 that can be displayedon the display device 202, to represent the real input device 102. Thevirtual trackpad 402 has a touch sensitive surface 404 and controlbuttons 406.

FIG. 5 shows an example of a virtual keyboard-trackpad combination 502that can be displayed on the display device 202, to represent the realinput device 102. The virtual keyboard-trackpad combination 502 includesa virtual keyboard 504 and a virtual trackpad 506.

FIG. 6 shows a virtual touchscreen 602 that can be displayed on thedisplay device 202, to represent the real input device 102. FIG. 6further shows a virtual stylus 604 that can be used to make inputs onthe virtual touchscreen 602. The user can hold an actual physicalstylus, and the virtual stylus 604 represents the physical stylus. Thevirtual stylus 604 is displayed on the display device 202 over thevirtual touchscreen 602. A camera or other sensor can be used to capturethe position and orientation of the physical stylus, and the displayedvirtual stylus 604 can have an orientation and position that correspondsto the captured position and orientation of the physical stylus. Inother examples, the physical stylus can include position and orientationsensors to measure a position and orientation of the physical stylus,and the measured position and orientation can be communicated to thesimulated reality system 106 to cause display of the virtual stylus 604at the corresponding position and orientation.

FIG. 7 illustrates an arrangement 702 of virtual function keys that canbe displayed on the display device 202, to represent the real inputdevice 102. A “function key” can refer to any key that is associatedwith a corresponding action. For example, a function key can include amacro key, where a “macro” can refer to a respective procedure that canbe executed in response to activation of the macro key.

FIG. 8 is a block diagram of a simulated reality input device 800according to examples. The simulated reality input device 800 of FIG. 8is an example of the real input device 102 shown in FIG. 1.

The simulated reality input device 800 includes a pressure sensitivesurface 804 and a controller 806. The controller 806 can include ahardware processing circuit or a combination of a hardware processingcircuit and machine-readable instructions executable on the hardwareprocessing circuit. Examples of a hardware processing circuit caninclude any or some combination of a microprocessor, a core of amulti-core microprocessor, a microcontroller, a programmable gate array,a programmable integrated circuit device, and so forth.

The controller 806 can perform various tasks, which include a firsttouch pressure indicating task 808 that sends a first indication to asimulated reality system (e.g., 106 in FIG. 1) that displays simulatedreality content and a virtual input device representing the input device800, in response to a first touch pressure applied at a given locationon the pressure sensitive surface 804.

The controller 806 can further perform a second touch pressureindicating task 810, which sends a second indication to the simulatedreality system in response to a different second touch pressure appliedat the given location on the pressure sensitive surface 804.

FIG. 9 is a block diagram of the simulated reality input device 802according to further examples. The simulated reality input device 802includes the pressure sensitive surface 804 and the controller 806depicted in FIG. 8. In addition, the simulated reality input device 802includes a sensor assembly 902, which can include a sensor (or multiplesensors) to detect touch input on the pressure sensitive surface 804.The sensor assembly 902 can also detect an amount of touch pressureapplied at each specific location on the pressure sensitive surface 804.The touch pressure applied on a given location on the pressure sensitivesurface 804 can include no pressure (which corresponds to a conditionwhere an input object, e.g., a user's finger or a stylus, is nottouching the given location of the pressure sensitive surface 804), afirst touch pressure (which corresponds to the input object lightlytouching at the given location on the pressure sensitive surface 804),and a second touch pressure (which corresponds to the input objectpressing down harder on the given location on the pressure sensitivesurface 804).

The simulated reality input device 802 further includes a vibrator 904,which can cause vibration of a portion of the pressure sensitive surface804, in response to any of the following: a user touching the pressuresensitive surface 804 with a first touch pressure, a user touching thepressure sensitive surface 804 with a second touch pressure, a controlelement being activated, or in response to the user touch on thepressure sensitive surface 804 moving between different locations of thepressure sensitive surface 804.

The simulated reality input device 802 also includes a mode togglecontrol element 906, which can be actuated by a user. In response toactuation of the mode toggle control element 906, the controller 806 cansend a mode toggle indication 908 to cause the simulated reality systemto switch from displaying a first virtual input device to displaying adifferent second virtual input device.

FIG. 10 shows another example relating to the simulated reality inputdevice 802, which has the pressure sensitive surface 804. In the exampleof FIG. 10, a physical overlay 1002 is physically arranged over thepressure sensitive surface 804. The physical overlay 1002 can includephysical structures (or physical overlay portions) corresponding to aspecific type of input device. The physical overlay 1002 provides hapticfeedback to the user as the user is using the input device 802.

In the example of FIG. 10, the physical overlay 1002 is a physicalkeyboard overlay, which has “key” structures 1004 corresponding to keysof a keyboard. The key structures 1004 can include protrusions orindentations that the user can feel as the users fingers touch the keystructures 1004. In some examples, the key structures 1004 can bedepressed by the user to simulate the depressing of keys of a keyboardduring typing. When a user presses down on a key structure 1004, acorresponding touch pressure is applied on the pressure sensitivesurface 804.

In other examples, the physical overlay 1002 can be a different type ofphysical overlay, such as a physical overlay for a touchpad.

FIG. 11 is a simplified view of a system 1100, which includes aprocessor 1102 to perform respective tasks, including a virtual inputdevice display task 1104 to cause display of a virtual input device on adisplay device, where the virtual input device corresponds to a pressuresensitive surface. The processor 1102 further performs a pressureresponding task 1106 to perform different tasks in response to differenttouch pressures applied on a given location of the pressure sensitivesurface.

A processor performing a task can refer to a single processor performingthe task, or to multiple processors performing the task. A processor caninclude a microprocessor, a core of a multi-core microprocessor, amicrocontroller, a programmable integrated circuit, a programmable gatearray, or another hardware processing circuit.

FIG. 12 is a block diagram of a non-transitory machine-readable orcomputer-readable storage medium 1200, which stores machine-readableinstructions that upon execution cause a system to perform variousactions. The machine-readable instructions include simulated realitycontent display instructions 1202, to cause display of simulated realitycontent and a virtual input device, the virtual input devicecorresponding to a pressure sensitive surface. The machine-readableinstructions further include first touch pressure respondinginstructions 1204 to cause display of a feedback indication relative toa control element of the virtual input device, in response to a firstindication of a first touch pressure applied on a given location of thepressure sensitive surface. The feedback indication can includehighlighting a control element of the virtual input device, ordisplaying an input object over the control element.

The machine readable instructions further include second touch pressureresponding instructions 1206 to activate the control element of avirtual input device in response to a second indication of a differentsecond touch pressure applied on the given location of the pressuresensitive surface.

The storage medium 1200 can include any or some combination of thefollowing: a semiconductor memory device such as a dynamic or staticrandom access memory (a DRAM or SRAM), an erasable and programmableread-only memory (EPROM), an electrically erasable and programmableread-only memory (EEPROM) and flash memory; a magnetic disk such as afixed, floppy and removable disk; another magnetic medium includingtape; an optical medium such as a compact disk (CD) or a digital videodisk (DVD); or another type of storage device. Note that theinstructions discussed above can be provided on one computer-readable ormachine-readable storage medium, or alternatively, can be provided onmultiple computer-readable or machine-readable storage media distributedin a large system having possibly plural nodes. Such computer-readableor machine-readable storage medium or media is (are) considered to bepart of an article (or article of manufacture). An article or article ofmanufacture can refer to any manufactured single component or multiplecomponents. The storage medium or media can be located either in themachine running the machine-readable instructions, or located at aremote site from which machine-readable instructions can be downloadedover a network for execution.

In the foregoing description, numerous details are set forth to providean understanding of the subject disclosed herein. However,implementations may be practiced without some of these details. Otherimplementations may include modifications and variations from thedetails discussed above. It is intended that the appended claims coversuch modifications and variations.

What is claimed is:
 1. A simulated reality input device comprising: apressure sensitive surface; a physical overlay on the pressure sensitivesurface, the physical overlay comprising a plurality of physicalstructures that correspond to respective displayed control elements of avirtual input device displayed on a display device and that comprises adisplayed representation of a real input device, wherein user touchinputs on respective physical structures of the plurality of physicalstructures correspond to touches of the respective displayed controlelements; and a processor to: in response to a first touch pressureapplied through the physical overlay at a first location on the pressuresensitive surface, send a first indication to a simulated reality systemthat displays simulated reality content and the virtual input device,wherein the simulated reality content is at least one selected fromamong a virtual reality content, an augmented reality content, or amixed reality content; and in response to a different second touchpressure applied through the physical overlay at the first location onthe pressure sensitive surface, send a second indication to thesimulated reality system.
 2. The simulated reality input device of claim1, further comprising: a vibrator to cause vibration of a portion of thepressure sensitive surface in response to at least one selected fromamong: a user touch on the pressure sensitive surface with the firsttouch pressure, a user touch on the pressure sensitive surface with thesecond touch pressure, activation of a displayed control element of thevirtual input device, or a user touch on the pressure sensitive surfacemoving between different locations of the pressure sensitive surface. 3.The simulated reality input device of claim 1, wherein the virtual inputdevice comprises a virtual keyboard.
 4. The simulated reality inputdevice of claim 1, further comprising a sensor assembly comprisingsensors to detect the first and second touch pressures.
 5. The simulatedreality input device of claim 1, wherein the physical overlay comprisesa physical keyboard overlay, and the plurality of physical structurescomprise key structures.